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Image processing method and image processing apparatus 



(57) . Disclosed is an image processing method and 
an image processing apparatus that improve quality of 
display images in different formats of a multi-format data 
broadcast image. The image processing method ac- 
cording to the present invention comprises the steps of : 
separating menu data, character data, still image data, 
and moving image data in a plurality of formats from a 
broadcast video signal; generating a layer image signal 



such that the image signal of data in each of the formats 
is superimposable on the data in the plurality of formats; 
and subjecting the superimposed layer image signal to 
adaptive image processing according to a preset pa- 
rameter by means of an adaptive image processing unit. 
Therefore, by subjecting each layer to different image 
processing irrespective of the type and the format of the 
signal, it is possible to perform image processing adapt- 
ed to each format. 
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Description 

[0001] The present invention relates to an image 
processing method and an image processing appara- 
tus, 

[0002] A conventional television receiver has dealt 
with only single-format image signals, and thus has not 
processed image signals in different formats. However, 
BS digital broadcast requires processing of data broad- 
cast data and still image broadcast data that are in a 
broadcast format different from that of a conventional 
image signal 

[0003] Fig. 1 shows a conventional multi-format data 
broadcast image. When a still image 44 and characters 
45 are displayed together with a moving image 43 in the 
data broadcast image 42 on a single screen, an HD 
(High Definition) image 41 can be displayed with high 
quality, while edges of the still image 44 and the char- 
acters 45 shine, thus making the still image 44 and the 
characters 45 less easy to see. 

[0004] However, when the still image 44 and the char- 
acters 45 are displayed together with the moving image 
43 in the above-mentioned conventional multi-format 
data broadcast image 42 on a single screen, areas of 
the still image 44, the characters 45, and the moving 
image 43 cannot be distinguished from each other be- 
cause the still image 44, the characters 45, and the mov- 
ing image 43 are mixed with each other to form a single 
image. Therefore, the still image 44, the characters 45, 
and the moving image 43 cannot be processed inde- 
pendently of each other for higher image quality. This 
results in a disadvantage in that although the HD image 
41 can be displayed with high quality, the still image 44 
and the characters 45 are lowered in image quality. 
[0005] Various respective aspects and features of the 
invention are defined in the appended claims. Features 
from the dependent claims may be combined with fea- 
tures of the independent claims as appropriate and not 
merely as explicitly set out in the claims. 
[0006] Embodiments of the present invention can pro- 
vide an image processing method and an image 
processing apparatus that improve quality of display im- 
ages in different formats of a multi-format data broad- 
cast image. 

[0007] The image processing method according to 
the present invention comprises the steps of: separating 
data in a plurality of formats from a broadcast video sig- 
nal; generating a layer image signal such that the image 
signal of data in each of the formats is superimposable 
on the data in the plurality of formats; and subjecting the 
superimposed layer image signal to adaptive image 
processing according to a preset parameter. 
[0008] Therefore, by subjecting each layer to different 
image processing irrespective of the type and the format 
of the signal, it is possible to perform image processing 
adapted to each format. 

[0009] Also, the image processing method according 
to the present invention generates a display section sig- 



nal for each layer image signal. Therefore, by determin- 
ing a display area for each layer, it is possible to readily 
perform different image processing for each layer. 
[0010] In addition, the image processing method ac- 

5 cording to the present invention generates the layer im- 
age signal and the display section signal on the basis of 
an arbitrarily changeable form. Therefore, it is possible 
to readily generate the signals on the basis of the 
changeable form. 

10 [0011] Moreover, the image processing apparatus ac- 
cording to the present invention comprises: separating 
means for separating data in a plurality of formats from 
a broadcast video signal; layer image signal generating 
means for generating a layer image signal such that the 

15 image signal of data in each of the formats is superim- 
posable on the data in the plurality of formats; and adap- 
tive image processing means for subjecting the super- 
imposed layer image signal to adaptive image process- 
ing according to a preset parameter. 

20 [0012] Therefore, by subjecting each layer to different 
image processing irrespective of the type and the format 
of the signal, it is possible to perform image processing 
adapted to each format. 

[0013] The image processing apparatus according to 
25 the present invention further includes storage means for 
storing a parameter in a table. Therefore, it is possible 
to make automatic setting for adaptive image process- 
ing. 

[0014] In addition, the image processing apparatus 
30 according to the present invention sets a parameter ac- 
cording to the status of a layer image signal. Therefore, 
it is possible to adjust image quality by performing adap- 
tive image processing according to the status of a layer 
image signal while viewing a data broadcast image on 
35 a television receiver. 

[0015] Thus, according to the present invention, the 
following actions are performed. 

[0016] The separating means subjects a video signal 
inputted thereto to digital processing to thereby sepa- 
40 rate menu data, character data, still image data, and 
moving image data. The separating means supplies the 
menu data, the character data, the still image data, and 
the moving image data to the layer image signal gener- 
ating means. 

45 [001 7] The layer image signal generating means gen- 
erates an OSD layer from the menu data, a character 
layer from the character data, a still image layer from 
the still image data, and a moving image layer from the 
moving image data. The layer image signal generating 

50 means generates an image signal for each of the OSD 
layer, the character layer, the still image layer, and the 
moving image layer. 

[001 8] The layer image signal generating means also 
generates a display section signal for each of the OSD 
55 layer, the character layer, and the still image layer, as 
well as layer image signals on which the OSD layer, the 
character layer, and the still image layer are superim- 
posed. The layer image signal generating means sup- 
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plies the display section signal for each of the layers and 
the superimposed layer image signals to the adaptive 
image processing means. 

[0019] The adaptive image processing means reads 
preset image processing parameters stored in a param- 
eter table in a table form. An image processing unit sub- 
jects each of the layer image signals to adaptive image 
processing for an area of its. display section signal ac- 
cording to the parameters stored in the parameter table. 
[0020] The invention will now be described by way of 
example with reference to the accompanying drawings, 
throughout which like parts are referred to by like refer- 
ences, and in which: 

Fig. 1 shows a conventional multi-format data 
broadcast image; 

Fig. 2 is a configuration block diagram showing a 
multi-format adaptive image processing system to 
be applied to an embodiment of the present inven- 
tion; 

Figs. 3A, 3B, and 3C illustrate layer pasting of multi- 
format data and parameter setting for each layer, 
Fig. 3A showing a moving image, Fig. 3B showing 
a still image, and Fig. 30 showing characters; and 
Fig. 4 shows an adaptive processed multi-format 
data broadcast image. 

[0021] An image processing method according to an 
embodiment of the present invention generates a layer 
image signal and a display section signal for each layer 
when displaying signals in different formats simultane- 
ously on a single screen. The image processing method 
can thereby perform image processing with optimum im- 
age quality parameters for each display area to display 
the signals. 

[0022] Fig. 2 shows configuration of a multi-format 
adaptive image processing system to be applied to the 
present embodiment. In this case, data in each format 
is sent by BS digital broadcast, for. example. 
[0023] A digital processing unit 1 in Fig. 2 subjects a 
BS digital broadcast signal S1 inputted thereto to digital 
processing to thereby separate menu data D1 , charac- 
ter data D2, still image data D3, and moving image data 
D4. 

[0024] A multi-screen processing unit 2 generates a 45 
multi-screen video signal S5 for multi-screen display 
and a display section signal S7 for the moving image 
data D4 from HD video S2 inputted to the multi-screen 
processing unit 2 and the moving image data D4 sup- 
plied from the digital processing unit 1 . so 
[0025] A layer generating and media superimposing 
unit 3 generates an OSD (On Screen Display) layer 4 
from the menu data D1 supplied from the digital 
processing unit 1 , a character layer 5 from the character 
data D2, a still image layer 6 from the still image data 55 
D3, and a moving image layer 7 from the moving image 
data supplied from the multi-screen processing unit 2. 
[0026] The layer generating and media superimpos- 



ing unit 3 also generates a display section signal S4 for 
each of the OSD layer 4, the character layer 5, and the 
still image layer 6 as well as layer image signals S3 on 
which the OSD layer 4, the character layer 5, and the 
still image layer 6 are superimposed. 
[0027] A CRT driver 8 reads preset image processing 
parameters stored in a parameter table 9 in a table form. 
An image processing unit 10 subjects each of the layer 
image signals S3 to optimum image processing for an 
area of its display section signal S4 according to the pa- 
rameters stored in the parameter table 9. Also in the 
case of the multi-screen video signal S5 , the CRT driver 
8 performs optimum image processing using S5 and S7. 
[0028] The thus formed multi-format adaptive image 
processing system applied to the present embodiment 
operates as follows. The multi-format adaptive image 
processing will be described in the following with refer- 
ence to Figs. 3A } 3B, and 3C. 

[0029] Figs. 3A, 3B ; and 3C illustrate layer pasting of 
multi-format data and parameter setting for each layer. 
Fig. 3A shows a moving image; Fig. 3B shows a still im- 
age; and Fig. 3C shows characters. 
[0030] The digital processing unit 1 in Fig. 2 subjects 
the BS digital broadcast signal S1 inputted thereto to 
digital processing to thereby separate the menu data 
D1 , the character data D2, and the still image data D3. 
The digital processing unit 1 supplies the menu data D1 , 
the character data D2, and the still image data D3 to the 
layer generating and media superimposing unit 3. 
[0031] In this case, the still image data D3 corre- 
sponds to the still image 22 shown in Fig. 3B, and the 
character data D2 corresponds to the characters 23 
shown in Fig. 3C. 

[0032] The multi-screen processing unit 2 generates 
the multi-screen video signal S5 and the display section 
signal S7 from the HD video S2 inputted to the multi- 
screen processing unit 2 and the moving image data D4 
supplied from the digital processing unit 1. The multi- 
screen processing unit 2 supplies the moving image da- 
ta D4 to the layer generating and media superimposing 
unit 3, and supplies the multi-screen video signal S5 and 
the display section signal S7 to the CRT driver 8. 
[0033] For simplicity, Fig. 3A shows a single frame of 
moving image. 

[0034] In this case, the moving image data corre- 
sponds to the high-quality moving image 21 shown in 
Fig.3A. 

[0035] The layer generating and media superimpos- 
ing unit 3 generates the OSD Iayer4 from the menu data 
D1 supplied from the digital processing unit 1 , the char- 
acter layer 5 from the character data D2, the still image 
layer 6 from the. still image data D3, and the moving im- 
age layer 7 from the moving image data D4 supplied 
from the multi-screen processing unit 2. The layer gen- 
erating and media superimposing unit 3 then supplies 
the OSD layer 4 ; the character layer 5, the still image 
layer 6, and the moving image layer 7 to the CRT driver 
8. 
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[0036] In Figs. 3A, 3B, and 3C, the OSD layer does 
not have data, and therefore the OSD layer is not shown 
in the figures. 

[0037] In this case, the character layers corresponds 
to a character layer 26 shown in Fig. 3C; the still image 5 
layer 6 corresponds to a still image layer 25 shown in 
Fig. 3B; and the moving image layer 7 corresponds to 
a moving image layer 24 shown in Fig. 3A. Images of 
the layers are thus pasted to the display area. 
[0038] Incidentally, each of the layer image signals 10 
may be set into a preset, arbitrarily changeable form. 
[0039] The layer generating and media superimpos- 
ing unit 3 also generates a display section signal S4 for 
each of the OSD layer 4, the character layer 5, and the 
still image layer 6 as well as the layer image signals S3 15 
on which the OSD layer 4 : the character layer 5, and the 
still image layer 6 are superimposed. The layer gener- 
ating and media superimposing unit 3 supplies the dis- 
play section signal S4 for each of the layers and the su- 
perimposed layer image signals S3 to the CRT driver 8. 20 
[0040] In this case, the display section signal S4 for 
the character layer 5 corresponds to a display section 
signal C of horizontal HC x vertical VC shown in Fig. 
3C; the display section signal S4 for the still image layer 
6 corresponds to a display section signal B of horizontal 25 
HB x vertical VB shown in Fig. 3B; and the display sec- 
tion signal S4 for the moving image layer 7 corresponds 
to a display- section signal A of horizontal HA x vertical 
VA shown in Fig. 3A. 

[0041] Incidentally, each of the display section signals 30 
may be outputted so as to correspond to a preset, arbi- 
trarily changeable form. 

[0042] The CRT driver 8 reads preset image process- 
ing parameters stored in the parameter table 9 in a table 
form. The image processing unit 1 0 subjects each of the 35 
layer image signals S3 to optimum image processing for 
an area of its display section signal S4 according to the 
parameters stored in the parameter table 9. 
[0043] In this case, parameter settings stored in the 
parameter table 9 are: parameter settings C (29) for the 40 
character layer 26 shown in Fig. 3C; parameter settings 
B (28) for the still image layer 25 shown in Fig. 3B; and 
parameter settings A (27) for the moving image layer 24 
shown in Fig. 3A. 

[0044] in this case, in the parameter settings C (29) 45 
for the character layer 26, image processing for sharp- 
ness, VM 5 dynamic picture, and hyper-white is off and 
therefore is not performed, while color temperature is 
set relatively high. 

[0045] In the parameter settings B (28) for the still im- 50 
age layer 25, image processing for sharpness, dynamic 
picture, and hyper-white is off and therefore is not per- 
formed, VM image processing is performed relatively 
weakly, and color temperature is set relatively low. 
[0046] In the parameter settings A (27) for the moving 55 
image layer 24, sharpness image processing is per- 
formed moderately, VM image processing is performed 
relatively strongly, image processing for dynamic picture 



and hyper-white is on and therefore is performed, and 
color temperature is set relatively high. 
[0047] It is to be noted that the sharpness processing 
enhances image sharpness. The VM processing pro- 
vides a three-dimensional appearance to the image by 
slowing asweep rate when luminance difference is large 
and normalizing the sweep rate when luminance differ- 
ence is small. The dynamic picture processing makes 
details clear by setting a portion of the lowest (black) 
level in a signal as black. The hyper-white processing 
enhances white level. The colortemperature processing 
renders white in a movie and other images sepia. 
[0048] Fig. 4 shows an adaptive processed multi-for- 
mat data broadcast image after being subjected to the 
above image processing, 

[0049] A data broadcast image 31 in Fig. 4 displays a 
moving image 32 subjected to the adaptive image 
processing with parameters A (35), a still image 33 sub- 
jected to the adaptive image processing with parame- 
ters B (36), and characters 34 subjected to the adaptive 
image processing with parameters C (37). 
[0050] In this case, since according to the set param- 
eters A (35), the sharpness processing is performed 
moderately, the sharpness of the moving image 32 is 
set to a moderate level . Since the VM processing is per- 
formed relatively strongly, the sweep rate is slowed rel- 
atively strongly when luminance difference is large and 
is normalized relatively strongly when luminance differ- 
ence is small. Since the dynamic picture processing is 
performed, the lowest black level is raised to make de- 
tails clear. Since the hyper-white processing is per- 
formed, white level is enhanced. Since the color tem- 
perature is set relatively high, white in a movie and other 
images is rendered sepia. 

[0051] Since according. to the set parameters B (36), 
the sharpness processing is not performed, the sharp- 
ness of the still image 33 is set to a low level. Since the 
VM processing is performed relatively weakly, the 
sweep rate is slowed relatively weakly when luminance 
difference is large and is normalized relatively weakly 
when luminance difference is small. Since the dynamic 
picture processing is not performed, black level is not 
changed. Since the hyper-white processing is not per- 
formed, white level is not enhanced. Since the colortem- 
perature is set relatively low, white remains as it is. 
[0052] Since according to the set parameters C (37), 
the sharpness processing is not performed, the sharp- 
ness of the characters 34 is set to a low level. Since the 
VM processing is not performed, the sweep rate is not 
slowed even when luminance difference is large and is 
not normalized even when luminance difference is 
small. Since the dynamic picture processing is not per- 
formed, black level is not changed. Since the hyper- 
white processing is not performed, white level is not en- 
hanced. Since the color temperature is set relatively 
high, white is rendered sepia. 

[0053] Thus, since the layer image signal and the dis- 
play section signal are generated for each of the layers, 
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the image processing unit in the succeeding stage can 
determine an image processing area by means of the 
display section signal. This allows the above-described 
adaptive image processing for sharpness, VM, dynamic 
picture, hyper-white, and color temperature to be per- 5 
formed for each of the layers according to the set pa- 
rameters A (35) , B (36), or C (37). 
[0054] It is to be noted that the parameter settings are 
not limited to those described above; the parameter set- 
tings may be changed for each layer and according to 10 
the status of a layer image signal. This makes it possible 
to adjust image quality by performing adaptive image 
processing according to the status of a layer image sig- 
nal while viewing a data broadcast image on a television 
receiver. 15 
[0055] Also, the kinds and descriptions of parameters 
are not limited to those described above; other image 
processing for enhancing or blurring an edge of an im- 
age and image processing in a Y system, a color differ- 
ence system, and an R, G, and B system may be used. 20 
[0056] In addition, the image quality of a still image 
may be improved so as to match the high quality of a 
moving image by performing interpolation processing 
and the like. 

[0057] Moreover, another image may be used as a 25 
background in the display section area for characters. 
[0058] Furthermore, a moving image, a still image, 
and character data may be inputted from a recording 
apparatus such as a digital camera or a personal com- 
puter. 30 
[0059] It is also to be noted that the present embodi- 
ment has been described by taking only BS digital 
broadcast as an example; however, the present inven- 
tion is of course applied to terrestrial digital broadcasts 
and cable digital broadcasts. 35 
[0060] In addition, optimum image processing be- 
tween moving images can be performed by using a mul- 
ti-screen function. Even when an NTSC (narrow video 
band) image is displayed on a left screen and an HD 
(wide video band) image is displayed on a right screen, 40 
a video parameter for the left screen and a video param- 
eter for the right screen can be set independently of 
each other. 

[0061] While a preferred embodiment of the present 
invention has been described using specific terms, such 45 
description is for illustrative purposes only, and it is to 
be understood that changes and variations may be 
made without departing from the scope of the following 
claims. 

[0062] In so far as the embodiments of the invention so 
described above are implemented, at least in part, using 
software-controlled data processing apparatus, it will be 
appreciated that a computer program providing such 
software control and a transmission, storage or other 
medium by which such a computer program is provided 55 
are envisaged as aspects of the present invention. 



Claims 

1 . An image processing method comprising the steps 
of: 

separating data in a plurality of formats from a 
broadcast video signal- 
generating a layer image signal such that the 
image signal of data in each of the formats is 
superimposable on said data in the plurality of 
formats; and 

subjecting the superimposed said layer image 
signal to adaptive image processing according 
to a preset parameter. 

2. An image processing method as claimed in claim t , 

wherein a display section signal for said layer 
image signal is generated. 

3. An image processing method as claimed in claim 1 , 

wherein said layer image signal is generated 
on the basis of an arbitrarily changeable form. 

4. An image processing method as claimed in claim 2, 

wherein said display section signal is gener- 
ated on the basis of an arbitrarily changeable form. 

5. An image processing method as claimed in claim 1 , 

wherein said parameter is stored in a table. 

6. An image processing method as claimed in claim 1 , 

wherein said parameter is set according to 
status of said layer image signal. 

7. An image processing method as claimed in claim 1 , 

wherein said data in the plurality of formats is 
inputted from a recording apparatus. 

8. An image processing apparatus comprising: 

separating means for separating data in a plu- 
rality of formats from a broadcast video signal; 
layer image signal generating means for gen- 
erating a layer image signal such that the image 
signal of data in each of the formats is super- 
imposable on said data in the plurality of for- 
mats; and 

adaptive image processing means for subject- 
ing the superimposed said layer image signal 
to adaptive image processing according to a 
preset parameter. 

9. An image processing apparatus as claimed in claim 
8, further including display section signal generat- 
ing means for generating a display section signal 
for said layer image signal. 

10. An image processing apparatus as claimed in claim 
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wherein said layer image signal is generated 
on the basis of an arbitrarily changeable form. 

11. An image processing apparatus as claimed in claim 5 

9, 

wherein said display section signal is gener- 
ated on the basis of an arbitrarily changeable form. 

12. An image processing apparatus as claimed in claim 10 
8, further including storage means for storing said 
parameter in a table. 

13. An image processing apparatus as claimed in claim 

8, 15 



... wherein said parameter is set according to 
status of said layer image signal. 



14. 



An image processing apparatus as claimed in claim 
8, 



20 



wherein said data in the plurality of formats is 
inputted from a recording apparatus. 
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(54) Image processing method and image processing apparatus 



(57) Disclosed is an image processing method and 
an image processing apparatus that improve quality of 
display images in different formats of a multi-format data 
broadcast image. The image processing method ac- 
cording to the present invention comprises the steps of: 
separating menu data, character data, still image data, 
and moving image data in a plurality of formats from a 
broadcast video signal; generating a layer image signal 



such that the image signal of data in each of the formats 
is superimposable on the data in the plurality of formats; 
and subjecting the superimposed layer image signal to 
adaptive image processing according lo a preset pa- 
rameter by means of an adaptive image processing unit. 
Therefore, by subjecting each layer to different image 
processing irrespective of the type and the format of the 
signal, it is possible to perform image processing adapt- 
ed to each format. 
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